EEEA-Net: An Early Exit Evolutionary Neural Architecture Search

نویسندگان

چکیده

The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable an on-device processor with limited computing resources, performing at substantially lower Architecture Search (NAS) costs. A new algorithm entitled Early Exit Population Initialisation (EE-PI) Evolutionary Algorithm (EA) was developed achieve both goals. EE-PI reduces the total number parameters in process by filtering models fewer than maximum threshold. It will look a model replace those more Thereby, reducing parameters, memory usage storage and processing time while maintaining same performance or accuracy. reduced 0.52 GPU day. This is huge significant achievement compared NAS 4 days achieved using NSGA-Net, 3,150 AmoebaNet model, 2,000 NASNet model. As well, networks (EEEA-Nets) yield network architectures minimal error computational cost given dataset as class algorithms. Using EEEA-Net on CIFAR-10, CIFAR-100, ImageNet datasets, our experiments showed that lowest rate among state-of-the-art models, 2.46% 15.02% 23.8% dataset. Further, we implemented image recognition architecture other tasks, such object detection, semantic segmentation, keypoint detection and, experiments, EEEA-Net-C2 outperformed MobileNet-V3 all these various tasks. (The code available https://github.com/chakkritte/EEEA-Net).

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Time-derivative Neural Net Architecture - an Alternative to the Time-delay Neural Net Architecture

Though the time-delay neural net architecture has been recently used in a number of speech recognition applications, it has the problem that it can not use longer temporal contexts because this increases the number of connection weights in the network. This is a serious bottleneck because the use of larger temporal contexts can improve the recognition performance. In this paper, a time-derivari...

متن کامل

Progressive Neural Architecture Search

We propose a method for learning CNN structures that is more efficient than previous approaches: instead of using reinforcement learning (RL) or genetic algorithms (GA), we use a sequential model-based optimization (SMBO) strategy, in which we search for architectures in order of increasing complexity, while simultaneously learning a surrogate function to guide the search, similar to A* search....

متن کامل

Differentiable Neural Network Architecture Search

The successes of deep learning in recent years has been fueled by the development of innovative new neural network architectures. However, the design of a neural network architecture remains a difficult problem, requiring significant human expertise as well as computational resources. In this paper, we propose a method for transforming a discrete neural network architecture space into a continu...

متن کامل

Evolutionary Architecture Search For Deep Multitask Networks

Multitask learning, i.e. learning several tasks at once with the same neural network, can improve performance in each of the tasks. Designing deep neural network architectures for multitask learning is a challenge: There are many ways to tie the tasks together, and the design choices matter. The size and complexity of this problem exceeds human design ability, making it a compelling domain for ...

متن کامل

Early exit: Estimating and explaining early exit from drug treatment

BACKGROUND Early exit (drop-out) from drug treatment can mean that drug users do not derive the full benefits that treatment potentially offers. Additionally, it may mean that scarce treatment resources are used inefficiently. Understanding the factors that lead to early exit from treatment should enable services to operate more effectively and better reduce drug related harm. To date, few stud...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Engineering Applications of Artificial Intelligence

سال: 2021

ISSN: ['1873-6769', '0952-1976']

DOI: https://doi.org/10.1016/j.engappai.2021.104397